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Abstract 

To what degree has the Civitas: An International Civic Education 
Exchange Program in Bosnia and Herzegovina been effective in creating or 
promoting attitudes and values that serve to strengthen support for democratic 
institutions and processes among Bosnia and Herzegovina school children? To 
answer this question, an empirical study was conducted with nearly two thousand 
upper elementary and secondary students in Bosnia and Herzegovina in May 
1 999. This report provides evidence of the effectiveness of the program based 
on a comparison of those who participated in Project Citizen and those who did 
not. The results indicate that civic education favorably affects students’ political 
knowledge and participatory skills, as well as attitudes and core values. 



The Importance of Civic Education in Bosnia and Herzegovina 

The Dayton Peace Accord created an opportunity whereby citizens of the new 
nation-state of Bosnia and Herzegovina have opportunities for meaningful 
political participation. But egalitarian and democratic styles of negotiation and 
interaction do not emerge fully formed in a population by virtue of a nation 
holding free elections (Flanagan and Sherrod 1998, 454-455). Well-designed 
institutions are not enough; democracy relies upon the values, attitudes, 
knowledge and skills of its citizens. Norms such as political compromise, support 
for fundamental rights of expression and assembly, political tolerance and 
support for the rule of law need to be acquired by citizens. Developing a political 
culture favorable to democracy is a process, both of learning by adults and of 
generational replacement. 

Research has demonstrated that while citizens master civic skills throughout their 
life cycle, early learning experiences are especially important. Adolescence is a 
critical period for students to develop support for democratic norms (Avery et al. 
1992). There are few agents of socialization available to policymakers in Bosnia 
and Herzegovina capable of positively affecting skills, attitudes and values of the 
next generation, so policymakers have turned to educational institutions. This is 
not surprising, as formal education in general and civic education in particular 
has always been central in theories of creating a democratic citizenry. Civic 
education, the goal of which is to promote "informed, responsible participation in 
political life by competent citizens” 1 committed to democratic values, is being 
implemented in Bosnia and Herzegovina. Will democracy establish firmer roots 
within this emerging political cohort? 

The next political generation is coming of age in an atmosphere rife with 
uncertainty. Four years of war shattered the country along ethnic lines. 



1 “National Standards for Civics and Government,” p. 1. 
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While the war ended with the formal acceptance of the terms in the Dayton 
Peace Accord, data from adults demonstrate that consensus on key issues has 
not been reached. USIA surveys of adults since 1995 confirm that majorities of 
Bosnian Serbs and Croats doubt the three ethnic groups can live together 
because the war has done too much damage. 2 Only Bosniacs (Bosnian 
Muslims) solidly support a multiethnic society. 3 Voting along ethnic blocs is still 
the norm in most regions. Data suggest that, overall, only Bosniacs have 
confidence in central government institutions. 4 Refugee resettlement remains 
painfully slow. Majorities of all three ethnic communities think that most 
politicians are corrupt. 5 And majorities among all three communities are 
concerned that the fighting might start again in a few years. 

The emerging political cohort in Bosnia and Herzegovina will require new skills to 
resolve these pressing problems within a democratic framework. To this end, the 
United States Department of Education, Office of Educational Research and 
Improvement, in cooperation with the United States Department of State, funds 
Civitas: An International Civic Education Exchange Program, administered 
by the Center for Civic Education. 6 Civitas@Bosnia and Herzegovina 
implements the program in BiH. 7 They have trained more than 3,500 elementary 
and secondary school teachers in civic education curricula in all three entities. 8 
In 1999 more than 43% of elementary and secondary schools were involved in 
Civitas programs. Teachers use modified curricula — lessons from Foundations 
of Democracy: Authority, Privacy, Responsibility, and Justice and Project 
Citizen — developed by the Center for Civic Education. In 1998-99, approximately 
100,000 students in BiH participated in Project Citizen. Since the program 
began in 1996, 200,000 have participated. Students who participate in Project 
Citizen do so voluntarily, usually in their homeroom free period or as an 
extracurricular activity. 9 



2 In October 1999, the United States Information Agency became a part of the U.S. Department of State. 
The research division is now called the Office of Research at the Department of State. 

United States Information Agency Report, “Public Opinion in Bosnia and Herzegovina, V 5: Two Years 
After Dayton Peace Accords,” April 1988, pp. 57-78. See also p. 38 

4 Ibid. p. 83 

5 Ibid. p. 87 

6 As aCivitas partner Bosnia and Herzegovina has been paired with the American states of California, 
Arizona and Nevada. Policymakers and educators from both countries have participated in exchange 
delegations focussed on improving civic education in both countries. 

Staffs at Civitas@Bosnia and Herzegovina, as well as the network of coordinators who work to 
implement the program throughout the country, were very helpful in assisting with this research. In addition, 
Professors Adila Kreso, Faculty of Philosophy, and Safet Smajkic, Pedagogic Academy, University of 
Sarajevo reviewed the survey instrument. 

8 Over 40 American educators have conducted professional development seminars with BiH teachers. 
Teachers from Minnesota, Ohio, Alaska, Massachusetts and many other states have shared their methods 
and content knowledge with educators in BiH. In return, educators from BiH have visited their partner sites 
in California, Nevada, and Arizona, visited classes and shared their experiences with American educators 
and students. 

In six out of ten cantons, Foundations of Democracy and Project Citizen have been adopted as a formal 
requirement. Adoption into the formal curriculum is expected to expand to all ten cantons in the Federation 
and to all elementary schools in Republic Srpska in 2000-01 . 



Program: Foundations of Democracy: Authority, Privacy Responsibility 
and_ Justice and Project Citizen 

The program in BiH has two components, with regional variations. First, students 
learn about the concepts of authority, privacy, responsibility and justice from the 
Foundations of Democracy series. They consider the difference between 
authority and power without authority, the need for authority, where authority is 
found, how rules and laws are made, and how to choose people for positions of 
authority. Students study the importance of responsibility and the conflicts 
between competing responsibilities. Finally, students learn about distributive, 
corrective, and procedural justice. For most students this is their first opportunity 
to consider and to discuss these concepts. 

Following the introduction of these four concepts, students begin Project 
Citizen, the centerpiece of the Civitas education program. Project Citizen 
teaches students how to monitor and influence public policy. Students work 
together and develop consensus building and political contacting skills. Project 
Citizen instructs students to follow six steps: 

• Identify public policy problems in their communities. 

• Select a problem for the class to study by voting on it. 

• Conduct research and gather information from libraries, newspaper 
offices, professors, lawyers, interest groups, legislative offices, 
administrative agencies, and other sources. 

• Develop a portfolio. Students discuss problems, evaluate alternative 
policies, and develop public policy. The class supports an action plan to 
get the class policy accepted. The portfolio is a documentary display that 
consists of four panels representing each of these steps. 

• Four teams of students present their portfolios forjudging in a simulated 
legislative hearing. Judges, who are often influential community members, 
act as legislative committee members and pose questions to students that 
allow them to demonstrate their knowledge and understanding of how 
public policy is formulated. 

• Reflect on their learning experience. The national competition in BiH takes 
place every May with winning teams from each of the cantons and 
regions. Winning elementary and secondary classes from each of the ten 
cantons compete in Sarajevo, and the top two classes from Republika 
Srpska present at the National Showcase. 

Many classes attempted to implement their policy proposals beyond the program 
requirements. This study found that well over half of all participating students, 
73%, tried to implement their public policy proposals. Nearly a third (30%) had 
success in implementing their proposals. One example of success was in 
Prijedor, where students succeeded in mustering newtrashcans, benches, and 
flowers for their city. 
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Research Design 



The population surveyed includes upper elementary, seventh and eight grade 
students, and secondary students, tenth through twelfth grade students, mostly 
twelfth grade students. In 1999, 200 elementary schools, out of a nationwide total 
of 459, had at least one class participating in Project Citizen. Out of 282 
secondary schools, 121 had a Project Citizen class. From a list of participating 
schools, 50 classes were randomly selected: 25 upper elementary, 25 
secondary. A total of 1,991 students were surveyed in May 1999. In addition, 50 
teachers whose classes participated also completed a short questionnaire. 

The sample was stratified by ethnicity. Within the Federation, Bosniacs comprise 
65% and Bosnian Croats 35% of participants in the program. So Bosniac and 
Bosnian Croat schools, which are mostly ethnically segregated, were randomly 
sampled by this ratio, 65/35. Serb students from the Republika Srpska also 
participate in the program, but unfortunately due to NATO bombing in nearby 
Kosovo, participating schools could not be surveyed. 

This study was post-test only. For each participating class, a control class (same 
grade, teacher, and school) was also surveyed. This provides a means to 
measure differences between students who participated in the program and 
those who did not. Because students chose to be in the program, it is possible 
that they were different to begin with. One limit to this post-test only design is that 
we cannot rule out that there were student differences at the outset. But if we do 
not see differences in the two groups from the post-test, we can rule out the 
effects of the program. 



Hypotheses: What Is Expected to Change 

Skills, knowledge, attitudes, and values important for exercising competent 
citizenship are measured in this survey. While the focus of Project Citizen is on 
the acquisition of knowledge and participatory skills directly related to addressing 
public policy problems, the interactive nature of the program was also 
hypothesized to foster positive democratic attitudes and values. 

What follows is a list of skills and knowledge, attitudes, and values that are 
expected to change. Please see Appendix A (p. 33) for a complete list of the 
question items. Multiple question items summed into indices test most of these 
hypotheses. 10 



10 Combining individual question items increases the reliability of the findings. Each index was tested using 
rotated factor analysis to ensure that it consisted of only one factor. Only indices with an alpha greater than 
.5 were used. In some instances, individual question items were tested. 
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Skills and Knowledge 

Participating in Project Citizen will increase: 

1. Persuasive and reasoning skills that are directly transferable to political action. 

2. Knowledge of how to gather information on an issue of public policy, from a variety of sources, 
including officials responsible for public policy. 

3. Political participation. 

4. Discussion of politics, as measured by attempting to persuade someone to vote for or support a 
specific candidate or cause. 

5. Knowledge about local government: who is responsible, who to contact, and how to influence 
government. 

6. Understanding of the importance of elections. 

7. Likelihood to vote if given the opportunity. 

8. Likelihood of someday running for public office. 

Attitudes 

Participating Project Citizen will result in an increased: 

9. Sense of external efficacy, that as a citizen, I can make the government listen and respond. 

10. Sense of internal efficacy, that I feel well prepared to participate in political and public life. 

1 1. Perception of the importance of the responsibilities and obligations of citizenship. 

12. Perception that government officials are accountable to the electorate. 

13. Reasoned political tolerance, both of groups and ideas. 

14. Interest in political affairs, demonstrated by increased attention to news and current events. 

Values 

Participating in Project Citizen will increase: 

1 5. Support for the rule of la w. 

1 6. Support for fundamental rights of expression, assembly and participation. 

17. Anti-authoritarian values. 

Results 

Of 1,991 students surveyed, 54% were high school students. Students were born 
between 1977 and 1988 (only one student was born in 1977), with the median 
age sixteen years. The war was a major part of their formative years, as 
evidenced by the 50% of students who reported that they were forced to leave 
their homes during the war. 
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There is a negative correlation between those forced to leave their home during 
the war and socioeconomic status. Students whose parents’ were forced to 
relocate during the war report slightly lower occupational prestige and education. 

Over 80% of the schools in this sample are urban or suburban, but the data 
suggest that those residing in rural areas were more likely to have been forced to 
relocate. In this study, correlations show that more Bosnian Croat students came 
from rural areas. This is also correlated with their reported lower parental socio- 
economic status and slightly greater wartime dislocation than for Bosniac 
students (mean difference .07) during the war. 

Ethnicities in this sample broke down as follows: 62.3% were Bosniac, 30.4% 
Bosnian Croat (predominately Catholic), and 5.4% were of mixed ethnicities. 

Less than 1% of students surveyed were Bosnian Serb, a reflection of regional 
group segregation following the war. 

Graph 1 



Ethnic Breakdown 




Students who opted to participate in civic education reported a higher grade point 
average, on a scale of 1-5, a mean difference of .3. This sample also contained 
more girls 58% than boys 42%. Girls reported a higher grade point average, 4.0 
than boys, 3.7 (on a scale of 1-5). Among all participating students the gender 
ratio was 60.5% female to 39.5% male. Other than the observation that students 
who report slightly higher grade point averages are more likely to participate in 
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this program, we’re not sure why girls would be more likely than boys to 
participate. 11 



Project Citizen is used in all school types, from trade schools to gymnasiums 
(college preparatory). A wide variety of schools were sampled. From the teacher 
survey, the best predictive variable to control for variation in school type was 
found to be their estimate of how many of their students would go on to college. 
Many of the students queried here by their teachers’ estimation are unlikely to 
attend college. 

Graph 2 



About how many students 
will go on to college? 




£ 



11 There is a dearth of research on youth in BiH, but prior research on gender differences in various 
countries over the past thirty years demonstrated that boys expressed greater interest and political 
knowledge than girls (Owen and Dennis 1988, Torney-Purta 1991). More recent research has found fewer 
gender differences in the U.S., particularly in anticipated future political participation (Hahn 1996, 20). Hahn 
suggests that data indicate differences in political interests, with females being more interested in political 
issues that might be labeled “social,” (welfare, abortion for example) and males being more interested in 
“patriotic issues” (military, world peace, economic competitiveness) (1996, 27). 
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Skills and Knowledge 



Project Citizen students gained most in participatory skills, research skills and in 
knowledge about local government. The first comparison of participating versus 
nonparticipating students will be explored through a difference in means test . 12 



Table 1. Differences in Means (T-Test) 





No Curriculum 


Curriculum 


Mean Difference 


Persuasive and Reasoning Skills 


6.25 

(199) 


6.83 

(1.89) 


.58** 


Research Skills - Media and Family 


8.19 

(2.43) 


9.24 

(2.16) 


1.05** 


Research Skills - Opinions of Leaders 


5.18 


6.94 


1.76** 


and Government Officials 


(136) 


(2.26) 


Political Participation - 


13.8 


17.63 


3.83** 


Contacting Officials 


(2.55) 


(4.59) 


Political Participation - Attending 


9.67 


9.92 


.25** 


Meeting, Protesting, Contacting 
Media, Persuading 


(2.37) 


(2.41) 


Knowledge about Local 


8.58 


9.98 


1.4** 


Government 


(3.11) 


(2.88) 


Likelihood of Voting in the Future 


4.88 


5.31 


.43** 


(1= Least Likely; 7=Most Likely) 


(2.25) 


(2.04) 



A!! differences are significant at p<.01 or p<.05, using either parametric or nonparametric tests. 

A double asterisk indicates that the probability of this result being due to chance is less than one in one hundred. 



The differences between participating students and the control group are all 
highly significant, indicating that the differences are not due to chance. 
Participating students show the greatest difference in political participation. They 
are more likely to have spoken with a government official about problems in their 
community; to rally support for a policy issue; have contacted a public official in 
person, via mail or by phone; and to have met with members of interest groups to 
obtain information. To a lesser extent, but still significantly greater than 
nonparticipants, Project Citizen participants attended council meetings, called 
political talk shows, and took part in protests. Participatory skills such as these 
form an integral link between citizens and public policy. These students are 
better able to express their preferences while reminding policy makers to whom 
they are accountable. 



1 2 

Difference is assessed through a standard difference in means test (a “t-test"). This test generates a 
probability that the difference in means is not due to chance. Probabilities of less than .05 are considered to 
be significant; the difference in means between participants and norvenrollees is evidence of an effect of the 
program. 




8 



u 



Civic education programs aim for informed political participation. Participants 
have gathered information on problems in their communities from scholars, 
lawyers, community organizations, and government officials, as well as media 
and family, to a greater extent than nonparticipants. These students report 
greater knowledge of which governmental branches or officials are responsible 
for various public policies. And they believe that they could identify and then take 
steps to influence members of their government. Participants report that they are 
better skilled at using facts and reason to analyze other peoples’ positions on 
problems and to explain problems to other people. 

On a 1-7 scale, Project Citizen students would be more likely to vote if given the 
opportunity (actual voting could not be measured as most students were 
ineligible during the last election cycle). 

These differences in means are positive, but does participation still matter when 
other variables, such as socioeconomic status, grade point average, age and so 
on, are factored into the equation? To determine this, the data were analyzed 
through ordinary least squares regression models. This is particularly important 
due to the absence of a pretest. It does not control for differences at the outset, 
but does allow us to control for other factors that pose competing hypotheses. 
The models for each of the measures are included on pages 20-32. Each 
measure of political knowledge and skill is the dependent variable (what we are 
seeking to explain). Prior research posits that age, for instance, should increase 
skills and knowledge. Likewise, students who have higher grades should score 
higher on the above measures. 

Participation in Project Citizen has a significant impact on skills and knowledge 
across all measures. 

The largest impacts are on political participation, research skills, and knowledge 
about local government. When controlling for other variables, participation 
increases scores on persuasive and reasoning skills, and even slightly on voting. 
These regression models are an important test for the effects of the program. 
While controlling for competing hypotheses (e.g. age, socioeconomic status, 
ethnicity, grade point average, gender) this study found that participation in the 
program increases students’ scores on all measures. Participation emerges as 
the best predictor in most of these models. 

Table 1 shows that older students, as might be expected, score higher on most 
items of participation and knowledge. They score higher than their younger 
cohort in knowledge about local government and political participation (attending 
meetings, protesting, etc.). The data reveal that older students are significantly 
more likely to vote if given the opportunity. 

Grade point average is not a particularly important variable in explaining political 
participation. Students with higher grades, as expected, do score higher on 
reported persuasive and reasoning skills. 




Controlling for gender reveals an interesting finding; while young women are 
more likely to have gathered information on a public policy from media, family, 
and friends, young males report greater knowledge about local government. 
Testing for program by gender interaction reveals that boys who participate in the 
program are more likely to have contacted public officials than are girls (Beta 
.24**). Girls who participate are more likely than boys to have conducted 
research (Beta .20**). Those were the only two interaction effects found for 
gender in this study. So, with the above exception noted, we can conclude that 
the program affects boys and girls similarly. 

Bosniacs score slightly higher on these measures of skills and knowledge across 
nearly all categories. All coefficients are small, but positive. When testing for 
interaction effects, Bosniacs who participate in Project Citizen contacted officials 
at higher rates, felt more efficacious, and thought that government officials 
should be more accountable than did Bosnian Croat participants. This finding 
might best be explained by surveys of adults between 1995 and 1998. These 
show that Bosniacs express greater confidence in local government and much 
greater confidence in the central government than do other ethnic groups. 13 
Greater confidence in public institutions are likely being transmitted by other 
agents of socialization (e.g., parents, media). This could result in Bosniac 
students reporting increased engagement and commitment to active citizenship 
in Bosnia and Herzegovina. 

Dislocation during the war depresses knowledge about local government, but it 
slightly increases students’ responses on gathering information from media and 
family. Parents’ education has a uniformly positive effect, when it is significant. 
Interestingly, higher parental education has no effect on students’ knowledge 
about local government; nor does it increase their likelihood of voting. Students 
who attended schools where most students go on to colleges are very slightly 
less likely to have attended meetings, protested, or contacted media. Socio- 
economic status is not an important predictor of political skills and knowledge of 
students. Participating in Project Citizen is the best predictor in most models. 
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Because this study was post-test only, both groups may have gained on these measures; We plan to 
conduct research in 2000-01 to answer this question. In surveys conducted since 1995, USIA, now the U.S. 
Department of State, has surveyed adults about their confidence in local and central government. In 1998, 
65% of Bosnian Croats and 72% of Bosniacs expressed confidence in local government. The gap widens in 
opinion toward the federal government. When asked, “How much confidence do you have in the central 
government of Bosnia and Herzegovina?” only 45% of Bosnian Serbs and 16% of Bosnian Croats, in 
contrast to 67% of Bosniacs, expressed confidence. USIA, “Public Opinion in Bosnia and Herzegovina,” 
“Volume V: Two Years After Dayton Peace Accord”, April 1998, pp. 121-122. 
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Among Project Citizen Students 

This study was conducted to determine what the effects of variations within 
treatment might be on skills and knowledge. The variables of interest to us are as 
follows. First, did students select their own topic? Project Citizen training 
instructs teachers to allow students to democratically select a public policy 
problem. Teachers, often in the best interest of students, intervene in the choice 
of “appropriate” public policy issue. 14 

Forty percent of students in this sample selected their own topic. The teacher 
selected the topic in only 7% or about two classes. In 53% of the classes, topics 
were selected by a combination of teacher and students. 




4 Research on other students in the U.S. and elsewhere is underway to determine whether teachers have 
difficulty in allowing students to select their own topic. Teachers may intervene for the best of reasons, such 
as righting students who get sidetracked into issues not addressable via public policy. Students may want to 
select a universal problem, such as world hunger, that they may not be able to address locally. 
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Activities Among Program Participants 




The above graph illustrates student participation at various stages within and 
beyond the program requirements. More than 90% of participating students 
presented a portfolio to adult judges. Over 79% of students competed. 78% of 
students identified the responsible governmental official or branch. These high 
figures demonstrate that the program is being well implemented. 

Seventy-five percent of students, excited by their policy proposals, went beyond 
the program requirements and tried to get their policies implemented. Thirty 
percent of students successfully implemented their policy proposals. Students 
with high grades are no more likely than those with low grades to attempt to 
implement their policy proposals. Students attending urban and suburban 
schools attempted to implement the public policy proposals at a greater rate than 
those who resided in rural areas. 
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Among participants, what effects does participation at these various levels have 
on political skills and knowledge? All regression models are included in the 
Appendix (pp. 20-32). In each model alternative hypotheses as well as 
differences within the program are controlled for. Students who select their topic 
score significantly higher on most measures. These include persuasive and 
reasoning skills, research skills, political contacting, and greater knowledge about 
local government, and higher scores on the voting scale. Correlations (not listed 
here) are positive with all other levels of program participation if students select 
their topics. Students’ excitement and their attempts to enact their proposed 
policy increase when they democratically select a topic of their own choosing. In 
order to maximize gains in political skills and knowledge, students should be 
encouraged to select their own topics. 

Students who competed show significant and large gains in their knowledge 
about local government and in participation measures. They also score higher on 
the research skills index and in persuasive and reasoning skills. 

Students who tried to implement their policy proposals gained more in research 
and contacting skills. They scored slightly lower in knowledge about local 
government. Perhaps when faced with the reality of implementing their policy, 
they realized that they did not know quite as much as their colleagues who did 
not attempt implementation. But the important finding here was that attempting to 
implement the public policy on the whole elevated scores. This was true 
regardless of whether the implementation was successful. Whether the proposed 
policy succeeded or failed had no impact on participants’ knowledge and skills. 
For improving knowledge and skills, attempting to implement a proposal is 
important, even if the proposal is not adopted. 



Political Attitudes 



A difference in means test reveals that there are positive differences in most 
political attitudes of Project Citizen students. The concept measuring political 
tolerance of groups has the largest mean differences. Participants are better able 
to grasp the responsibilities of citizenship. They are more likely to agree that they 
can work to make changes in their community and to solve community problems. 
They think they are more responsible for respecting the rights of people with 
whom they disagree strongly. They also think that public officials have an 
obligation to be accountable to the electorate. The multivariate model of the 
perceived importance of citizen responsibility shows that participation in Project 
Citizen is highly significant and moderately increases the scores of participating 
students along this scale. Good grades and student age are better able to 
account for attitudes on government officials’ accountability (participation in the 
program is not significant in this model, p.25). 
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Table 7 (p.28) reveals that among participants, those who presented a portfolio, 
those who identified responsible officials, and those who successfully 
implemented their policy perceive the responsibilities of citizens as more 
important. Students with higher grades and who chose their own topic are more 
likely to think that officials should be accountable to the electorate and should 
protect their rights (this finding contrasts with those who successfully 
implemented their policy). 

Political tolerance of groups and ideas is an important goal of civic education. 
Project Citizen does not explicitly teach “tolerance” but students do work 
together in groups and make collective decisions. They present their opinions to 
peers and adult judges. They discuss ideas that may be controversial. The data 
reveal that participants are more politically tolerant of less threatening groups. 
These include environmentalists, women’s groups, religious groups, human 
rights groups, and student groups. This is important, as civil society requires 
citizens to become accustomed to tolerating the competing demands of various 
groups, within reason. When we look at regression coefficients, program 
participation has a modest impact on the tolerance of these groups. Better 
students tolerate these groups at a higher rate. Female students are also more 
politically tolerant of these groups. 15 Bosnian Croats score somewhat higher on 
the tolerance scale, controlling for all other factors. Project Citizen students who 
chose their own topic score slightly lower on political tolerance of groups. Those 
who tried to implement their public policy scored higher, regardless of whether 
they were effective or not. 

As might be expected, Project Citizen students are not more tolerant of 
threatening groups than other students. Both would restrict the liberty of these 
groups to petition government. These groups— nationalists, separatists, and 
armed bands — have played a destructive role in the lifetimes of these students. 
Those with higher grades are slightly less tolerant of these groups. Males are 
slightly more tolerant. Students who implemented their own policy were more 
tolerant of threatening groups than those who did not. 

Project Citizen students are more tolerant of ideas. That is, they are more likely 
to agree that there is more than one reasonable position on a policy, that all 
groups should be allowed to influence government, and that some groups should 
not be excluded from running for public office. Program participation is significant 
even when other variables are controlled for. The coefficients are not large, but 
these small positive effects are promising, especially since this civic education 
program does not mention or teach the concept of tolerance explicitly. 
Competition increased tolerance for different points of view, as did student 
control over the topic selected. Presenting a portfolio had mixed results on this 
measure, but it did have a positive effect on allowing all groups to run for office. 




15 This finding is a bit unusual as prior research in other countries found females in general to be somewhat 
less tolerant than males ( Golebiowska 1999). 
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Because more than 90% of students presented a portfolio, the difference 
between them and the 10% who did not is not particularly important. 
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Table 2. Attitudes: Differences in Means (T-T est) 



External Efficacv 


No Curriculum 


Curriculum 


Mean Difference 


There is no way to make officials listen. 


2.82** 


2.68 


.14** 




(115) 


(117) 




If 1 do not care about an election, 


3.50 


3.47 


.03 


then 1 do not need to vote. 


(1 36) 


(1.42) 




Internal Efficacy 








1 have a good understanding of 


6.15** 


6.53** 


.38** 


important political issues, and am well 


(1.64) 


(1.65) 




prepared to participate. 








People like me have no say 


2.48 


2.30 


.18** 


about what government does. 


(1.39) 


(128) 




Responsibilities of Citizens 








Perceived importance of 


11.04 


11.75 


.70** 


responsibilities of citizens. 


(2.38) 


(2.1) 




Responsibilities of Public Officials 








Government officials are not 


3.65 


3.41 


.24** 


accountable to the electorate. 


(176) 


(169) 




Political Tolerance of Groups 








Politically tolerant of less 


20.27 


21.09 


« 

« 

Csj 

°0 


threatening groups. 1 


(4.07) 


(3.32) 




Politically tolerant of 


6.91 


6.87 


.04 


threatening groups. 2 


(2.4) 


(2.13) 




Political Tolerance of Ideas 








Sometimes there is more than one 


3.67 


3.88 


.21** 


reasonable position on policy. 


(.84) 


(.81) 




All groups in my community should 


3.67 


3.86 


.19** 


be allowed to influence a government. 


(103) 


(10) 




Members of some groups should 


2.68 


2.48 


.19** 


not be allowed to run for elective office. 


(1.27) 


(1.25) 




Attention to News 








Read the front-page news 


2.54 


2.75 


.21* 




(2.22) 


(2.28) 




Watch a news program on TV 


3.83 


3.94 


.11 




(2.36) 


(2.31) 




Seek out news on TV 


1.96 


1.94 


.01 




(.92) 


(.93) 





Aii differences are significant at p<.01 or p<05, using either parametric or nonparametric tests. 

1. Environmentalist, women's groups, religious groups, women’s rights groups, and student groups. 

2. Nationalist groups, separatist groups, and armed bands. 
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Participating students score slightly higher on one measure of external efficacy. 

In the regression equation, participation in Project Citizen is the only measure 
that has any impact on students’ perceptions that they can get officials to listen to 
them (this perception may mirror reality; public officials may not be particularly 
responsive in this emerging democracy). Policymakers in emerging democracies 
need to grow accustomed to responding to constituent’s demands. Elections are 
a crucial aspect of this sort of accountability. For the full participation model 
advocated by Rousseau, Pateman, and others, voting is crucial. Students’ 
agreement with the statement that “if a person doesn’t care about an election, he 
or she shouldn’t vote”, suggests that establishing regular voting habits among 
youth may be challenging. To be fair, this sentiment appears to be shared by 
their cohorts in established democracies like the United States, where voting 
turnout among young people is low. However, the regression model reveals that 
Project Citizen students are less likely to agree with this statement when other 
factors are held constant. Those who attempted to implement their proposed 
policy think that they can get officials to listen to them, regardless of their 
success. 

Participation in Project Citizen has a positive and significant impact on internal 
efficacy. Regression reveals that, even when all other factors are controlled for, 
students feel that they better grasp important political issues and are prepared to 
participate. They think that people like themselves can have a say about what 
government does. The data show that Bosniac youth also possess a higher 
sense of internal efficacy. 

In attention to news, the only difference between participants and nonparticipants 
has to do with reading the front-page news. Project Citizen students read a 
newspaper on average of 2.8 days per week in contrast to 2.5 days per week for 
nonparticipants. Regression models show that when other variables are 
controlled for, this difference becomes insignificant. Instead, older students and 
those who have better educated parents are more likely to read the front page of 
a newspaper. Students who were forced to relocate during the war read the 
paper less often. 



Values 



Values are harder to change than knowledge or attitudes, but participating 
students showed positive changes among the three values measured in this 
survey. Fundamental rights were professed with greater support from 
participants. These included freedom or the right to express political views, to join 
social and political groups, to organize public meetings to criticize the actions of 
authorities, ask officials for information, and of refugees to return to their homes. 

Multivariate regression shows that participation in the program continues to be 
significant when other factors such as age, average grade, and socioeconomic 
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status are controlled for. Older students, high achievers and those who 
participated in Project Citizen were more supportive of fundamental rights. 
Students who attend schools where most of their colleagues will go on to college 
were less supportive (and were also higher on the authoritarianism scale). The 
coefficient is small but highly significant. Among participants, those with higher 
grades, those who selected their own topics, and those who identified public 
officials responsible for their policy area were more supportive of fundamental 
rights. 



Table 3. Values: Differences in Means (T-Test) 





No Curriculum 


Curriculum 


Mean Difference 


Importance of the Rule of Law 








(Note- lower scores indicate greater support) 
1=Most Supportive 


12.44 


11.91 


.53** 


5=Least Supportive 


(3.2) 


(3.1) 




Importance of Fundamental Rights 








1=Most Important 


8.02 


7.29 


.73** 


5=Least Important 


(2.64) 


(2.41) 




Authoritarianism 








1 -Least Authoritarian 


5.14 


4.87 


.27** 


5-Most Authoritarian 


(2.06) 


(2.04) 





Reported are the mean scores, with the standard deviation in parentheses. 

All differences are significant at p<.01 or p<.05, using either parametric or nonparametric tests. 



In addition, Project Citizen students are more supportive of the rule of law. 

When asked whether it was okay to break laws you don’t agree with, or to 
suspend laws in times of emergency to solve problems, or to obey laws you 
consider unjust, or to ignore the law and solve problems immediately, students 
were less likely to respond in the affirmative. Rule of law is essential in this 
emerging democracy.,. In this time of rapid transition, it is important that the 
emerging political cohort have a sense that rule of law should not be arbitrary. 
This may foster a sense of moral outrage when laws are broken. 16 Among 
program participants, those who selected their pubic policy issues and who 
competed were more supportive of rule of law. Interestingly, the 272 students 
who reported success in implementing their policy proposals scored slightly lower 
on this index. 



16 Political corruption is considered by adults to be a major problem. Over half of adults polled in Bosnia and 
Herzegovina think that most politicians are corrupt. USIA Report (April 1998, 87). 
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The final value measured in this survey was authoritarianism. The difference in 
means is small but significant. Students that participated in Project Citizen were 
less likely to agree that a new government ought to be able to “rule with an iron 
hand” for the peoples’ own good, or that elected officials should sometimes have 
unlimited power in order to achieve important goals. Those who participated in 
the program score slightly lower on the authoritarian scale, as do those with 
higher grades and who are female. Bosniacs and students who attend a college 
preparatory school score slightly higher on the authoritarian scale than do 
Bosnian Croats or those who attended vocational schools. 



Conclusion 



Students who participated in Project Citizen report greater levels of political 
participation. They have contacted officials about problems in their community, 
met with members of interest groups, attended local council meetings, contacted 
the media, and marched or protested more than nonparticipants. More than 75% 
of participating students go beyond the program requirements and attempt to 
implement their public policies, and 30% reported success. Those students who 
selected their own policy issue tended to report increased gains, including a 
greater likelihood to vote. Participating students conducted more research on 
problems in their communities, reported greater knowledge of local government 
and felt more efficacious. This fits into the goal of civic education — increasing 
informed political participation. This in turn increases individual rights and 
advances the public good, as well as strengthens the regime. Political 
participation may also foster desirable psychological components in individuals. 
Panel analysis of Project Citizen students is needed to ascertain whether these 
effects hold over time. 

Project Citizen participants demonstrate greater political tolerance toward some 
groups than do nonparticipants. They are more tolerant of ideas and of allowing 
other groups to run for office. These effects are small, but significant. This is 
important in a country struggling to emerge from the destruction of war. In 
addition, participating students are more supportive of the rule of law. They are 
more supportive of fundamental rights. Participants are also slightly less 
authoritarian than nonparticipants. 

The results from this study show that Project Citizen positively affects skills and 
knowledge, and, to a lesser extent, attitudes and values that are supportive of 
democracy. Previous research on various civic education programs has not 
always found significant results, although the findings in this literature are mixed 
and underdeveloped (Jennings and Langton 1968; Jennings and Niemi 1974; 
Torney-Purta 1997; Niemi and Junn 1998; Hahn 1998). This study provides new 
data for the debate over the efficacy of civic education. The positive results of 
this study contribute to work that demonstrates modest but measurable gains in 
knowledge, attitudes and values resulting from civic education (Niemi and Junn 
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1998). This study provides new insights into the debate over the efficacy of civic 
education. In almost every measure used in the survey, the data support 
policymakers’ efforts to use civic education to foster positive changes in youths’ 
skills, attitudes, and values supportive of democratic institutions and processes. 
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For those unfamiliar with reading regression tables, please look at the first entry, under student characteristics, .04. Note 
that there is no asterisk. Asterisks denote significance. This means that .04 could be due merely to chance; year born has 
no effect on this index measuring persuasive and reasoning skills. Continuing down the column we come to the first 
significant finding, .29**. A double asterisk indicates that there is less than one chance in ninety-nine that these results 
were due to chance. We can be very confident that there are differences between groups. The correct interpretation is 
that students who report higher grades score higher on the scale of persuasive and reasoning skills. The u B n or 
standardized coefficient reflects effect size, .13**, is moderate and positive. This means that grade has an effect on these 
skills, holding year born, grade, sex, refugee status, socioeconomic status and treatment constant. If you continue down 
the column you will note that Bosniacs, in contrast to other ethnic groups, and those whose parents’ have higher 
education and, finally, those who participated in Project Citizen score significantly higher on the above index. The largest 
effect is .14**, the standardized coefficient from Project Citizen participation. 



Table 4. Multivariate Model of Skills and Knowledge: Comparing Participants v. Nonparticipants Page 1 of 2 



Skills and Knowledge 

Column A: Unstandardized 
Coefficients/Standard Errors 


Reasoning and Persuasive 
Skills 


Research Skills* 
Media and Family 


Research Skills -Opinion 
Leaders , Government Officials 


Column B: Standardized Coefficients 


Column A 


Column B 


Column A 


Column B 


Column A 


Column B 


Student Characteristics 














Year Born 


.04 


.04 


.00 


.01 


-08** 


.08** 




(03) 




(.04) 




(.03) 




Average Grade 


.29** 


.13** 


.04 


.02 


.13* 


.06* 




(07) 




(.08) 




(06) 




Male 


-.03 


-.01 


-.74** 


-.16** 


-.21 


-.05 




(ID 




(14) 




(.12) 




Bosniac 


.36** 


.09** 


.42** 


.09** 


.33** 


« 

* 

00 

o 




(.11) 




(13) 




(.12) 




Refugee (during war) 


.01 


.00 


.37** 


.08** 


.03 


.01 




(11) 




(13) 




(ID 




Father’s & Mother's 


.13** 


.12** 


.13** 


.10** 


.12** 


.11** 


Education 


(04) 




(.04) 




(.03) 




Father's & Mother's 


.02 


.06 


.02 


.06 


.02 


.05 


Occupation 


(.01) 




(.01) 




(.01) 




School Characteristic 














More Students 


-.04 


-.03 


-.03 


-.02 


.04 


.03 


Go on to College 


(.05) 




(.06) 




(.05) 




Treatment 














Participated in 


.55** 


.14** 


.93** 


.20** 


1.62** 


.41** 


Project Citizen 


(.11) 




(13) 




(.12) 




Adjusted R Square 


.08 




.1 




.22 





Table entries are OLS regression coefficients. *p<05, **p<01 or pc.001 (two tailed t-test). 
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Table 4. Multivariate Model of Skills and Knowledge: Comparing Participants v. Nonparticipants Page 2 of 2 



Skills and Knowledge 

Column A: Unstandardized 
Coefficients/Standard Errors 

Column B: Standardized 
Coefficients 


Political Participation 
Contacting Officials 

Column A Column B 


Political Participation - 
Attended Meetings, 
Marched, Contacted 
Media, Persuaded 

Column A Column B 


Knowledge 

Local 

Government 
Column A Column B 


Likelihood of Voting 
(Scale 1-7) 

Column A Column B 


Student Characteristics 


















Year Born 


.03 


.02 


.17** 


.13** 


.13* 


.08* 


.19** 


.16** 




(06) 




(.04) 




(05) 




(.04) 




Average Grade 


.14 


.03 


-.14 


-.06 


.14 


.04 


.10 


.04 




(12) 




(08) 




(10) 




(.08) 




Male 


-.34 


-.04 


.26 


.06 


.60** 


.10** 


.20 


.05 




(21) 




(.14) 




(.18) 




(13) 




Bosniac 


.74’* 


.09** 


.12 


.03 


.68** 


.11** 


.27* 


.06* 




(21) 




(.14) 




(.18) 




(.13) 




Refugee (during war) 


-.18 


-.02 


.14 


.03 


-.43* 


-.07* 


.21 


.05 




(21) 




(14) 




(18) 




(.13) 




Father's & Mother's 


.07 


.03 


.17** 


.13** 


.08 


.05 


.08 


.07 


Education 


(.07) 




(.05) 




(-06) 




(-04) 




Father's & Mother’s 


.07** 


.10** 


.02** 


.04** 


.03 


.05 


.00 


.02 


Occupation 


(.02) 




(.02) 




(.02) 




(.02) 




School Characteristic 


















More Students 


-.01 


.00 


-.17** 


-.08** 


-.04 


-.01 


-.09 


-.05 


Go on to College 


(09) 




(07) 




(08) 




(.06) 




Treatment 


















Participated in 


3.78** 


.48** 


.38** 


.08** 


1 .45** 


.23** 


.30* 


.07* 


Project Citizen 


(20) 




(13) 




(.17) 




(.13) 




Adjusted R Square 

TiKIq antriae ara /"M C rnnpnaair 


.26 




.04 




.09 




.03 






Table entries are OLS regression coefficients, *p< 05, **p<.01 or p< 001 (two tailed t-test). 
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Table 5. Multivariate Model Measuring Skills and Knowledge of Only Students Who Participated in 
Project Citizen Page 1 of 2 



Skills and Knowledge 
b: Unstandardized 


Persuasive and 
Reasoning Skills 


Research Skills - 
Media and Family 


Research Skills - 
Opinion Leaders and 
Government Officials 


Coefficients/Standard Errors 














B. Standardized Coefficients 


b 


B 


b 


B 


b 


B 


Student Characteristics 














Year Born 


.01 


.01 


.01 


.01 


.11* 


.09* 




(04) 




(•05) 




005) 




Average Grade 


.37** 


.16** 


.11 


.04 


.4** 


.15** 




(09) 




(12) 




Oil) 




Male 


-.03 


-.01 


-.5** 


-.12** 


-.31 


-.07 




(15) 




(.17) 




(.18) 




Bosniac 


.42** 


.11** 


.59** 


.14** 


.30 


.07 




(.15) 




(18) 




(.18) 




Refugee (during war) 


.17 


.04 


.00 


.00 


-.19 


-.05 




(.14) 




(.17) 




(.17) 




Father's & Mother's 


.13** 


.12** 


.11* 


.10* 


.09 


.08 


Education 


(.05) 




006) 




(06) 




Father's & Mother's 


.02 


.05 


.01 


.01 


.02 


.05 


Occupation 


(.02) 




(.02) 




(.02) 




Differences within Proaram 














Chose Own Topic 


00 

* 

» 


.12** 


-.10 


-.02 


.53** 


.12** 




(.15) 




(.17) 




(.18) 




Prepared a Portfolio 


.21 


.03 


-1.34** 


-.19** 


-1.92** 


-.26** 




(.30) 




(.35) 




035) 




Competed 


.71** 


.15** 


.44 


.09 


.8** 


.15** 




(.22) 




025) 




(.26) 




Identified Responsible 


.01 


.00 


-.09 


-.02 


.41 


.08 


Officials 


(19) 




022) 




(.23) 




Tried to Implement 


-.27 


-.06 


.48* 


.10* 


.45* 


.09* 


Proposed Policy 


(18) 




(21) 




021) 




Successfully 


.69 


.02 


-.12 


-.03 


-.14 


-.03 


Implemented Policy 


(.16) 




019) 




019) 




Adjusted R Square 


.12 




.06 




.12 





Table entries are OLS regression coefficients. *p<.05, **p<.01 or p< 001 (two tailed t-test). 
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Table 5. Multivariate Model Measuring Skills and Knowledge of Only Students Who Participated in Project 
Citizen Page 2 of 2 



Skills and Knowledge 

b: Unstandardized 
Coefficients/Standard Errors 

B: Standardized Coefficients 


Political Participation 
Contacting Officials 

b B 


Political Participation - 
Attended Meetings, 
Marched, Contacted 
Media, Persuaded 

b B 


Knowledge 

Local 

Government 

b 


B 


Likelihood of Voting 
(Scale 1-7) 

b B 


Student Characteristics 


















Year Born 


.09 


.04 


.12* 


.08* 


.05 


.03 


.06 


.05 




(.09) 




(.06) 




(-06) 




(.05) 




Average Grade 


.45* 


.08* 


-.27* 


-.09* 


.43** 


.13** 


.16 


.06 




(.21) 




(13) 




(.13) 




(.11) 




Male 


-.84* 


-.09* 


.49* 


.1* 


.44* 


.08* 


.05 


.01 




(35) 




(.20) 




(.22) 




(-17) 




Bosniac 


1.21** 


.13** 


.28 


.06 


.46* 


.08* 


.33 


.08 




(.35) 




(.21) 




(.22) 




(-18) 




Refugee (during war) 


-.19 


-.02 


.16 


.03 


-.33 


-.06 


.53** 


.13** 




(.33) 




(19) 




(.20) 




(.17) 




Father's & Mother's 


.21* 


.09* 


.2** 


.15** 


.15* 


.1* 


.01 


.01 


Education 


(.11) 




(.07) 




(07) 




(.06) 




Father’s & Mother's 


.06 


.07 


.00 


-.01 


.03 


.05 


.04 


.1 


Occupation 


(.04) 




(02) 




(.02) 




(02) 




Proa ram Differences 


















Chose Own Topic 


1.17** 


.13** 


-.44* 


-.09* 


1.03** 


.18** 


.54** 


.13** 




(.35) 




(.21) 




(.22) 




(.18) 




Prepared a Portfolio 


-1.66* 


-.11* 


-.51 


-.06 


-.53 


-.05 


-.83* 


-.12* 




(.69) 




(.41) 




(.43) 




(-35) 




Competed 


2.8** 


.25** 


.79** 


.13** 


1.47** 


.21** 


.43 


.09 




(5) 




(.29) 




(.31) 




(26) 




Identified Responsible 


1 .97** 


.18** 


.58* 


.1* 


1.37** 


.2** 


.00 


.00 


Government Officials 


(.45) 




(.27) 




(28) 




(-23) 




Attempted to Implement 


.84’ 


* 

00 

o 


-.03 


-.01 


-.58* 


-.09* 


.00 


.00 


Proposed Policy 


(.42) 




(.25) 




(26) 




(.21) 




Successfully 


.35 


.04 


.18 


.04 


-.06 


-.01 


-.26 


-.06 


Implemented Policy 


(.39) 




(.22) 




(22) 




(-19) 




Adjusted R Square^ 


.23 




05 





... —2 


— 


.04 





Table entries are OLS regression coefficients. *p< 05, **p< 01 or pc.001 (two tailed t-test). 
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Table 6. Multivariate Model Comparing Attitudes of Participants v. Nonparticipants Page 1 of 3 



Attitudes 




External Efficacv 








Internal Efficacv 


b: Unstandardized 
Coefficients/Standard Error 

B: Standardized Coefficients 


There is no way to 
make officials listen. 


If 1 do not care about 
an election then 1 do 
not need to vote 


1 have good 
understanding of 
important political 
issues. 


People like me have 
no say about what 
government does. 




b 


B 


b 


B 


b 


B 


b 


B 


Student Characteristics 


















Year Born 


.03 


.05 


.07** 


.1** 


.17** 


.18** 


.01 


.01 




(02) 




(.02) 




(3) 




(02) 




Average Grade 


-.08 


-.06 


.01 


.01 


.09 


.05 


.12* 


.08* 




(04) 




(-05) 




(06) 




(05) 




Male 


.03 


.01 


-.13 


.04 


.37** 


.12** 


.18* 


.06* 




(07) 




(.08) 




(10) 




(08) 




Bosniac 


6.74 


.03 


-.03 


-.01 


.78** 


.23** 


.3** 


.11** 




(07) 




(-08) 




CD 




(08) 




Refugee (during war) 


.07 


.03 


-.05 


-.02 


.01 


.00 


-.08 


-.03 




(.07) 




(.08) 




CD 




(08) 




Father's & Mother's 


-.02 


-.03 


.06* 


.07* 


.04 


.05 


.02 


.03 


Education 


(02) 




(03) 




(03) 




(02) 




Father's & Mother's 


.00 


-.01 


.02 


.05 


.02* 


.07* 


.03** 


.10** 


Occupation 


(01) 




(01) 




(01) 




(01) 




School Characteristic 


















More Students 


.04 


.04 


.14** 


.11** 


-.07 


-.05 


.06 


.06 


go on to college 


(03) 




(04) 




(05) 




(04) 




Treatment 


















Participated in 


-.18” 


* 

* 

oo 

o 


-.19* 


-.07* 


.38** 


.11** 


-.26** 


-.10** 


Project Citizen 


(07) 




(.08) 




(09) 




(08) 




Adjusted R Square 


.01 




.03 




.10 




.04 





Table entries are OLS regression coefficients, *p< 05, **p<01 or p< 001 (two tailed t-test). 



best copy available 

ERIC 



28 



25 



Table 6. Multivariate Model Comparing Attitudes of Participants v. Nonparticipants Page 2 of 3 



Attitudes 

b: Un standardized 


Perceived importance of 
responsibilities of 
citizens. 


Government officials are 
not accountable to the 
electorate. 


Politically tolerant of 
student groups, religious 
groups, environmentalist, 
women’s rights groups. - 
Less threatening groups 


Politically tolerant of 
nationalist groups, 
separatist groups, and 
armed band groups. - 
More threatening groups 


Coefficients/Standard Errors 


















B: Standardized Coefficients 


b 


B 


b 


B 


b 


B 


b 


B 


Student Characteristics 


















Year Born 


.08* 


.06* 


.07* 


.07* 


.08 


.04 


.03 


.03 




(04) 




(03) 




(.06) 




(04) 




Average Grade 


.19* 


.07* 


« 

« 

CM 

CO 

i* 


.17** 


.47** 


.11* 


-.17* 


-.07* 




(08) 




(.06) 




(.13) 




(.08) 




Male 


.00 


.00 


.06 


.02 


-1.18** 


-.16** 


« 

CM 

CO 


.07* 




(.14) 




(1) 




(22) 




(.14) 




Bosniac 


.3* 


.06* 


.11 


.03 


-.44* 


-.06* 


-.1 


-.02 




(.13) 




(1) 




(22) 




(.14) 




Refugee (during war) 


-.09 


-.02 


.00 


.00 


-.1 


-.01 


.06 


.01 




(13) 




CD 




(22) 




(.14) 




Father's & Mother's 


.03 


.02 


.05 


.05 


-.10 


-.05 


.06 


.05 


Education 


(.04) 




(.03) 




(07) 




(04) 




Father's & Mother's 


.00 


.61 


-.02 


-.05 


.03 


.05 


-.01 


-.04 


Occupation 


(02) 




(.01) 




(.02) 




(01) 




School Characteristic 


















More Students 


.04 


.02 


.06 


.04 


-.07 


-.02 


-.09 


-.05 


Go on to college 


(.06) 




(.05) 




CIO) 




(.06) 




Treatment 


















Participated in Civitas 


.68** 


.15** 


-.14 


-.04 


.56** 


.08** 


.08 


.61 


Project Citizen 


(.13) 




CD 




(21) 




(.13) 




Adjusted R Square 

T ikln anlriap am Hi C 


.04 


t. ^ AC i 


.03 




.06 


- 







Table entries are OLS regression coefficients, *p<.05, **p<.01 or p<.001 (two tailed t-test). 
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Table 6. Multivariate Model Comparing Attitudes of Participants v. Nonparticipants Page 3 of 3 



Attitudes 






Political Tolerance of Ideas 










b: Unstandardized 


Sometimes there is 
more than one 
reasonable position 
on policy. 


AH groups in my 
community should be 
allowed to influence 
government. 


AH groups should be 
allowed to run for 
office. 


Read the front-page news. 


Coefficients/Standard Errors 


















B: Standardized Coefficients 


b 


B 


b 


B 


b 


B 


b 


B 


Student Characteristics 


















Year Born 


.04** 


.09** 


.03 


.06 


.02 


.03 


.15** 


.13** 




(.01) 




(02) 




(-02) 




(04) 




Average Grade 


« 

« 

00 

o 


* 

* 

00 

o 


.11** 


.1** 


.06 


.04 


.06 


.02 




(03) 




(04) 




(-05) 




(08) 




Male 


.00 


.00 


.00 


.00 


-.03 


-.01 


.2 


.04 




(.05) 




(-06) 




(08) 




(13) 




Bosniac 


.01 


.01 


.15* 


.07* 


-.15* 


-.06* 


.05 


.01 




(-05) 




(.06) 




(.08) 




(13) 




Refugee (during war) 


-.07 


-.04 


.02 


.01 


-.01 


.00 


-.52** 


-.11** 




(.05) 




(06) 




(08) 




(13) 




Father’s & Mother’s 


.02 


.05 


.03 


.06 


-.03 


-.04 


.24** 


.19** 


Education 


(.01) 




(-02) 




(.03) 




(04) 




Father’s & Mother's 


-.01 


-.01 


.00 


.01 


.13 


.05 


.02 


.06 


Occupation 


(.01) 




(01) 




(.01) 




(01) 




School Characteristic 


















More students 


-.08** 


-.01** 


.05 


.05 


.11** 


.1** 


-.01 


-.01 


Go on to College 


(.02) 




(03) 




(.04) 




(.06) 




Treatment 


















Participated in 


.15** 


.09** 


.18** 


.09** 


.19* 


.07* 


.15 


.03 


Project Citizen 


(.05) 




(.06) 




(.07) 




(13) 




Adjusted R Square 


.03 




.03 




.02 









Table entries are OLS regression coefficients, *p<.05, **p<01 or p<,001 (two tailed t-test). 
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BEST COPY AVAILABLE 



Table 7. Multivariate Model Measuring Attitudes of Only Students Who Participated in Project 
Citizen Page 1 of 4 



Attitudes 




External Efficacv 




Internal Efficacv 




There is no way to 




If 1 do not care about an 


1 have a good understanding 




make officials listen. 


election then 1 


l do not 


of important political issues, 


b: Unstandardized 






need to vote. 




and am well prepared to 


Coefficients/Standard Errors 










participate. 




B: Standardized Coefficients 


b 


B 


b 


B 


b 


B 


Student Characteristics 














Year Born 


.00 


.00 


.06 


.08 


.10** 


.10** 




(03) 




(.03) 




(.04) 




Average Grade 


-.16** 


-.11** 


.05 


.03 


.13 


.06 




(06) 




(.07) 




(.08) 




Male 


.07 


.03 


-.23 


-.08 


.31** 


.09 




(.10) 




(-12) 




(13) 




Bosniac 


-.05 


-.02 


-.18 


-.06 


.92** 


.27** 




(.10) 




M2) 




(.13) 




Refugee (during war) 


.00 


.00 


-.23* 


-.08* 


.07 


.02 




(.10) 




(.11) 




(.12) 




Father's & Mother's 


-.01 


-.01 


.02 


.02 


.08 


.08 


Education 


(03) 




(.04) 




(.04) 




Father's & Mother's 


.00 


.00 


.03* 


.10* 


.02 


.06 


Occupation 


(.01) 




(.01) 




(.01) 




Differences within Proa ram 














Chose Own Topic 


.06 


.02 


.03 


.01 


.33** 


.10* 




(10) 




(12) 




(.13) 




Prepared a Portfolio 


.28 


.07 


.96** 


.19** 


.58 


.10 




(.21) 




(24) 




(.26) 




Competed 


-.10 


-.03 


-.54** 


-.15** 


.28 


.07 




(.15) 




(.17) 




(.19) 




Identified Responsible 


.15 


.05 


.38* 


.11* 


.13 


.03 


Officials 


(13) 




(16) 




(.17) 




Tried to Implement 


-.40” 


.14** 


-.06 


-.02 


-.34* 


-.08* 


Proposed Policy 


(12) 




(15) 




(-16) 




Successfully 


.21 


.08 


.05 


.02 


.29* 


.08* 


Implemented Policy 


(11) 




(13) 




(.14) 




Adjusted R Square 


.02 




.06 




.18 





Table entries are OLS regression coefficients. *p<.05, **p<.01 or p<.001 (two tailed t-test). 
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Table 7. Multivariate Model Measuring Attitudes of Only Students Who Participated in Project 
Citizen Page 2 of 4 



Attitudes 

b: Unstandardized 
Coefficients/Standard Errors 

B: Standardized Coefficients 


Internal Efficacy 

People like me have 
no say about what 
government does. 

b B 


Responsibilities of 
Citizenship 

Perceived importance of 
responsibilities of 
citizens. 

b B 


Responsibilities of 
Government 

Government officials are 
not accountable to the 
electorate. 

b B 


Student Characteristics 














Year Born 


.02 


.02 


.07 


.06 


.02 


.03 




(03) 




(.05) 




(.04) 




Average Grade 


.01 


.01 


.41** 


.16** 


-.41** 


-.21** 




(07) 




(.11) 




(.08) 




Male 


-.04 


-.01 


.10 


.02 


.13 


.04 




(.12) 




(.17) 




(13) 




Bosniac 


-.54** 


-1.19** 


.21 


.05 


.10 


.03 




(.12) 




(17) 




(.13) 




Refugee (during war) 


-.06 


-.02 


-.19 


-.05 


-.05 


-.02 




(id 




(16) 




(.13) 




Father's & Mother's 


0 


0 


.02 


.02 


.05 


.06 


Education 


(01) 




(.05) 




(.04) 




Father's & Mother's 


.04** 


.13** 


.01 


.02 


-.01 


-.05 


Occupation 


(.01) 




(.02) 




(.01) 




Differences within Proaram 














Chose Own Topic 


-.28 


-.10 


.21 


.05 


-.40** 


-.12** 




(.12) 




(17) 




(.13) 




Prepared a Portfolio 


1.22** 


.23** 


.77* 


.11* 


.56 


.10 




(.23) 




(.34) 




(.27) 




Competed 


-.24 


-.07 


-.06 


-.01 


.10 


.03 




(.17) 




(.25) 




(.19) 




Identified Responsible 


.16 


.04 


.66** 


.13** 


-.20 


-.05 


Officials 


(15) 




(.22) 




(.17) 




Tried to Implement 


.19 


.06 


-.10 


-.02 


.25 


.06 


Proposed Policy 


(.14) 




(21) 




(16) 




Successfully 


.03 


.01 


.39* 


.09* 


.52** 


.15** 


Implemented Policy 


(13) 




(.19) 




(.14) 




Adjusted R Square 


.08 




.08 




.08 





Table entries are OLS regression coefficients. *p<.05, **p<.01 or p<.001 (two tailed t-test). 
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Table 7. Multivariate Model Measuring Attitudes of Only Students Who Participated in Project 
Citizen Page 3 of 4 



Attitudes 

b: Unstandardized 


Politically tolerant of 
student groups, religious 
groups, environmentalist, 
women's rights groups. - 
Less threatening groups 


Politically tolerant of 
nationalist groups, 
separatist groups, and 
armed band groups. - 
More threatening groups 


Political tolerance of ideas; 
Sometimes there is more 
than one reasonable 
position on policy. 


Coefficients/Standard Errors 
B: Standardized Coefficients 


b 


B 


b 


B 


b 


B 


Student Characteristics 














Year Born 


.06 


.03 


.03 


.02 


.01 


.02 




(.07) 




(.05) 




(.02) 




Average Grade 


. 42 ** 


.11** 


-.13 


-.05 


.07 


.08 




(.16) 




(ID 




(.04) 




Male 


-.9** 


-.14 


.32 


.08 


.01 


.01 




(.26) 




(.18) 




(.06) 




Bosniac 


-.29 


-.04 


.28 


.06 


.02 


.01 




(.26) 




(.18) 




(.07) 




Refugee (during war) 


.04 


.01 


.16 


.04 


-.09 


-.06 




(.25) 




(.17) 




(.06) 




Father's & Mother's 


-.07 


-.04 


.07 


.06 


.03 


.09 


Education 


(.08) 




(.06) 




(.02) 




Father's & Mother's 


-.01 


-.01 


-.03 


-.08 


-.01 


-.05 


Occupation 


(.03) 




(.02) 




(.01) 




Differences within Proaram 














Chose Own Topic 


-.74** 


-.12** 


-.47* 


-.11* 


.29** 


.18** 




(.26) 




(.18) 




(.07) 




Prepared a Portfolio 


.43 


.04 


.11 


.01 


-.39** 


-.14** 




(.52) 




(.36) 




M3) 




Competed 


-.13 


-.02 


-.30 


-.06 


.37** 


.19** 


- • 


(.38) 


- - 


(.26) 




(.09) 




Identified Responsible 


-.20 


-.03 


.20 


.04 


.10 


.05 


Officials 


(34) 




(23) 




(.08) 




Tried to Implement 


.82** 


.11** 


-.01 


.00 


-.04 


-.02 


Proposed Policy 


(32) 




(22) 




(.08) 




Successfully 


.40 


.06 


.67** 


.15** 


-.14* 


-.08* 


Implemented Policy 


(.29) 




(20) 




(.07) 




Adjusted R Square 


.06 




.03 




.07 





Table entries are OLS regression coefficients. *p<.05, **p<.01 or pc.001 (two tailed t-test). 
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Table 7. Multivariate Model Measuring Attitudes of Only Students Who Participated in 
Project Citizen Page 4 of 4 



Attitudes 




Political Tolerance of Ideas 






All groups in my 
community should be 
allowed to influence 


All groups should be 
allowed to run for office. 


b: Unstandardized 


a government. 






Coefficients/Standard Errors 
B: Standardized Coefficients 


b 


B 


b 


B 


Student Characteristics 










Year Born 


.02 


.03 


.03 


.04 




(02) 




(-03) 




Average Grade 


.15** 


.12** 


.11 


.07 




(05) 




(-07) 




Male 


-.04 


-.02 


-.03 


-.01 




(08) 




(11) 




Bosniac 


.25** 


.13** 


-.23* 


-.09* 




(08) 




(.11) 




Refugee (during war) 


.06 


.03 


-.06 


-.02 




(08) 




(10) 




Father’s & Mother’s 


.01 


.03 


.02 


.04 


Education 


(-03) 




(03) 




Father's & Mother’s 


.00 


.00 


.01 


.03 


Occupation 


(.01) 




(01) 




Differences within Proaram 










Chose Own Topic 


-.05 


-.03 


-.11 


-.04 




(.08) 




(-11) 




Prepared a Portfolio 


.03 


.01 


.59** 


.13** 




(.17) 




(.22) 




Competed 


-.01 


.00 


-.06 


-.02 




(.12) 




M6) 




Identified Responsible 


.29** 


.12** 


.19 


.06 


Officials 


(11) 




(.14) 




Tried to Implement 


-.10 


-.04 


.23 


.07 


Proposed Policy 


(.10) 




(.13) 




Successfully 


.00 


.00 


-.01 


.00 


Implemented Policy 


(09) 




(12) 




Adjusted R Square 


,04 




.03 





Table entries are OLS regression coefficients. *p<.05, **p<01 or p< 001 (two tailed t-test). 
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Table 8. Multivariate Model Comparing Values of Participants v. Nonparticipants 



Skills and Knowledge 


Importance of Rule of Law 


Importance of Fundamental Rights 


Authoritarianism 




1=Most Supportive 


1=Most Important 




1=Least Authoritarian 


b: Unstandardized 
Coefficients/Standard Errors 


5=Arbitrary 




5=Least Important 




5=Most Authoritarian 


B: Standardized Coefficients 


b 


B 


b 


B 


b 


B 


Student Characteristics 














Year Born 


.03 


.02 


.22** 


.16** 


-.08* 


-.07* 




(06) 




(.04) 




(04) 




Average Grade 


-.15 


-.04 


-.58** 


-.20** 


-.33** 


-.14** 




mu 




(09) 




(07) 




Male 


-.39* 


-.06* 


-.05 


-.01 


-.26* 


-.06* 




(19) 




(15) 




(.12) 




Bosniac 


.20 


.03 


-.22 


-.04 


.61** 


.14** 




(19) 




(.15) 




(.12) 




Refugee (during war) 


.04 


.01 


-.06 


-.01 


.06 


.02 




(19) 




(15) 




(.12) 




Father’s & Mother's 


.04 


.02 


.02 


.02 


.02 


.02 


Education 


(06) 




(05) 




(04) 




Father’s & Mother's 


.00 


.01 


-.01 


-.01 


.00 


.00 


Occupation 


(02) 




(.02) 




(.01) 




School Characteristic 














More Students 


-.19* 


-.07* 


.28** 


.13** 


« 

* 

CM 

CNJ 


.12** 


Go on to College 


(09) 




(07) 




■ (06) 




Treatment 














Participated in 


-.66** 


-.10** 


-.40** 


.08** 


-.25* 


-.06* 


Project Citizen 


(19) 




(.14) 




(.12) 




Adjusted R Square 


.02 




.06 




.05 





Table entries are OLS regression coefficients. *p<.05, **p<.01 orp< 001 (two tailed t-test). 
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Table 9. Multivariate Model of Values of Only Students Who Participated in Project Citizen 



Skills and Knowledge 


Importance of 
Rule of Law 


Importance of 
Fundamental Riahts 


Authoritarianism 


b: Unstandardized 


1=Most Supportive 


1=Most Important 


1=Least Authoritarian 


Coefficients/Standard Errors 


5=Arbitrary 




5=Least Important 


5=Most Authoritarian 


B: Standardized Coefficients 


b 


B 


b 


B 


b 


B 


Student Characteristics 














Year Born 


.01 


.01 


.04 


.03 


.04 


.36 




(07) 




(.06) 




(.05) 




Average Grade 


-.16 


-.04 


-.59** 


-.19** 


-.21* 


-.08* 




(26) 




(.23) 




(.10) 




Male 


-.38 


-.06 


.39 


.08 


-.30 


-.07 




(.26) 




(.20) 




(.17) 




Bosniac 


.41 


.06 


-.02 


-.01 


.55** 


.13** 




(.26) 




(.21) 




(.17) 




Refugee (during war) 


.04 


.01 


-.25 


-.05 


-.03 


-.01 




(25) 




(19) 




(.16) 




Father's & Mother’s 


.13 


.08 


-.01 


-.01 


-.03 


-.02 


Education 


(08) 




(.06) 




(.05) 




Father's & Mother's 


-.01 


-.01 


.01 


.03 


.02 


.06 


Occupation 


(03) 




(-02) 




(.02) 




Differences within Proaram 














Chose Own Topic 


-.67** 


-.11** 


-.51** 


-.10** 


-.65** 


-.15** 




(.27) 




(.21) 




(.17) 




Prepared a Portfolio 


.27 


.03 


-.43 


-.05 


1.05** 


.15** 




(.57) 




(.41) 




(.34) 




Competed 


-1.21” 


-.16** 


.27 


.04 


.03 


.01 




(38) 




(3) 




(.25) 




Identified Responsible 


.34 


.09 


-.89** 


.15** 


-.07 


-.01 


Officials 


(00) 




(.26) 




(-22) 




Tried to Implement 


.22 


.7 


.25 


.04 


.38 


.08 


Proposed Policy 


(32) 




(.25) 




(.21) 




Successfully 


1 .22” 


.18** 


.14 


.03 


.48** 


.11** 


Implemented Policy 


(28) 




(.22) 




(19) 




Adjusted R Square 


.05 




.07 




.07 





Table entries are OLS regression coefficients. *p<.05, **p<.01 or p<.001 (two tailed t-test). 
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Appendix A- Question items and indexes 

Persuasive and Reasoning skills, directly transferable to political action: 

I am skilled at explaining problems in my community or country to other people. 

I am skilled at using facts and reason to analyze other people’s positions on problems. 

Research Skills: As part of a school assignment or for some other reason, I have gathered information 
on problems in my community from: 

Skills 1. 

Newspapers, Radio, Television, Family and friends 
Skills 2. 

Professors or Scholars, Lawyers or Judges, Community Organizations or Nongovernmental Organizations 
(NGOs), Government Offices 

Participation in Politics: Within the fast six months have you as a part of a class assignment or for 
some other reason: 

Participation 1. 

spoken with a government official about problems in your community? 

tried to get other people to support your solution to a problem in your community or country? 

written a letter to a government official? 

phoned a government official? 

met with members of interest groups to obtain information? 

made an appointment and visited a government official by yourself or with a group? 

Participation 2. 

attended a local council meeting? 
called a TV/radio news/political talk show? 
taken part in a protest or march? 

tried to persuade someone to vote for a specific candidate or cause? 



Know about local government, who is responsible, who to contact, how to influence government: 

If there were a problem in your community, would you know what governmental official or branch might be 
responsible for such problems? 

Could you find the governmental official or branch that is responsible for solving a particular problem in your 
community? 

Do you know the steps to take to influence members of your government? 

Better grasp the importance of elections 

Having elections ensures that elected officials will pay attention to what the people think when it decides 
to act. 



Respond that, if given the opportunity, I would be more likely to vote: 
(Scale 1-7.) “vote” 

Run for office. 

Someday I might like to run for an elected office. 



External efficacy, perceptions about government responsiveness to citizen demands: 

If government officials are not interested in hearing what people like me think, there is really no way to make 
them listen. 

If a person doesn’t care how an election comes out, he or she shouldn’t vote on it. 
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Internal efficacy: 



I feel I have a pretty good understanding of the important political issues facing our country. 
I feel well prepared for participating in political and public life. 

People like me don't have any say about what the government does. 



Grasp responsibilities of citizenship: 

I can work with others to make changes in my community. 

I try to help solve problems in my community. 

I am responsible for respecting the rights of people with whom I disagree strongly. 

Citizens are responsible for keeping themselves informed about public issues. 

Citizens, as members of a society, have an obligation to participate in public life. 

Grasp concept that public officials are accountable to the electorate: 

Once elected, government officials are not responsible for listening to the opinions of the people in their 
communities. 

Elected officials are only responsible for protecting the rights of the people who elected them. 

Demonstrate increases in reasoned political tolerance, of groups and ideas: 

Tolerance 1. (Less threatening groups). 

Environmentalists 
Women's groups 
Religious groups 
Human rights groups 
Student groups 

Tolerance 2. (More threatening groups). 

Nationalist groups 
Separatist groups 
Armed bands. 

Tolerance 3. (Ideas) 

Sometimes there is more than one reasonable position on what should be done about a problem in my 
community or country. 

All groups in my community should be allowed to try to influence government. 

Members of some groups should not be allowed to run for elective office. 

Interest in political affairs via attention to news: 

How many days a week do you usually read the front-page news in the newspaper? 

How many days a week do you usually watch a news program, such as the evening news on television? 
Is news something you try to watch on TV, or do you just see it because someone else has it on? 

Support for the rule of law: 

If you don't agree with a law, it is all right to break it. 

In times of emergency, the government ought to be able to suspend law to solve pressing social 
problems. 

It is not necessary to obey a law you consider unjust. 

Sometimes it is better to ignore the law and solve problems immediately rather than wait for a legal 
solution 

Support for fundamental rights of expression, assembly and participation: 

Freedom to express your political views. 

Freedom to join and participate in social and political groups. 

The right of all refugees to return to their homes. 
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The right to be able to organize public meetings to criticize the actions of authorities. 

I have the right to ask government officials for information. 

Authoritarianism: 

When a government is in the early stages of creating a new society the people must often be “ruled with 
an iron hand” for their own good. 

Elected officials should sometimes have unlimited power in order to achieve important goals. 
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